Dynamic Data Placement for Collision Avoidance among Concurrent Write Streams

ABSTRACT

A memory sub-system configured to dynamically generate a media layout to avoid media access collisions in concurrent streams. The memory sub-system can identify plurality of media units that are available to write data concurrently, select commands from the plurality of streams for concurrent execution in the available media units, generate and store a portion of a media layout dynamically in response to the commands being selected for concurrent execution in the plurality of media units, and executing the selected commands concurrently by storing data into the memory units according to physical addresses to which logical addresses used in the selected commands are mapped in the dynamically generated portion of the media layout.

RELATED APPLICATION

The present application claims priority to Prov. U.S. Pat. App. Ser. No.62/844,054, filed May 6, 2019 and entitled “Dynamic Data Placement forCollision Avoidance among Concurrent Write Streams,” the entiredisclosure of which is hereby incorporated herein by reference.

FIELD OF THE TECHNOLOGY

At least some embodiments disclosed herein relate to memory systems ingeneral, and more particularly, but not limited to dynamic dataplacement for collision avoidance among concurrent streams of sequentialwrites in a logical space.

BACKGROUND

A memory sub-system can include one or more memory devices that storedata. The memory devices can be, for example, non-volatile memorydevices and volatile memory devices. In general, a host system canutilize a memory sub-system to store data at the memory devices and toretrieve data from the memory devices.

BRIEF DESCRIPTION OF THE DRAWINGS

The embodiments are illustrated by way of example and not limitation inthe figures of the accompanying drawings in which like referencesindicate similar elements.

FIG. 1 illustrates an example computing system that includes a memorysub-system in accordance with some embodiments of the presentdisclosure.

FIG. 2 shows a dynamic data placer configured to determine a medialayout in a way that reduces and/or avoids collisions in concurrentmedia accesses in writing data.

FIG. 3 shows an example of a memory sub-system having dynamic dataplacement.

FIG. 4 illustrates an example of data structures configured to supportdynamic data placement.

FIG. 5 shows a method of dynamic data placement.

FIG. 6 illustrates an example of dynamic media layout determination.

FIG. 7 is a block diagram of an example computer system in whichembodiments of the present disclosure can operate.

DETAILED DESCRIPTION

At least some aspects of the present disclosure are directed to dynamicdata placement in a memory sub-system for collision avoidance amongconcurrent streams of sequential writes in a logical address space. Amemory sub-system can be a storage device, a memory module, or a hybridof a storage device and memory module. Examples of storage devices andmemory modules are described below in conjunction with FIG. 1. Ingeneral, a host system can utilize a memory sub-system that includes oneor more components, such as memory devices that store data. The hostsystem can provide data to be stored at the memory sub-system and canrequest data to be retrieved from the memory sub-system.

A media layout specifies the mapping between the addresses used incommands received in a memory sub-system from a host system and thephysical memory locations in the memory media of the memory sub-system.Fixed media layouts can lead to media access collisions among activewrite streams, increased buffer lifetime, and/or increased bufferingrequirements. Buffer lifetime corresponds to the lifetime of data beingbuffered in a memory sub-system before the data is committed, written,stored, or programmed into the memory media of the memory sub-system.For example, the host system to which a memory sub-system is connectedto, a garbage collection process running in the memory sub-system,and/or one or more write streams from the host system (e.g., for writingin different zones of a namespace configured in the memory subsystem)can generate multiple streams of write commands. The memory media canhave multiple memory devices capable of writing data in parallel. Thus,at least some of the streams of write commands can be executed in thememory sub-system in parallel in committing date into the memory mediaof the memory sub-system. However, one memory device can support onewrite operation at a time. When two write commands are mapped by themedia layout to operate on a same memory device, an access collisionoccurs. Each collision increases the corresponding buffer lifetime. Themedia layout can be randomized by mapping logical addresses to randommemory locations in the memory media of the memory sub-system.Randomized media layout can reduce collisions. However, when apredetermined media layout is used, collisions can still occur even whenthe number of write streams is equal to or smaller than the number ofmemory devices that can independently perform write operations inparallel.

At least some aspects of the present disclosure address the above andother deficiencies through dynamic data placement. For example, thedetermination of the portion of a media layout for the logical addressesused in incoming write commands can be postpone until the write commandscan be executed without collision. When the memory media is configuredon integrated circuit dies (e.g., as NAND memory cells), the medialayout determination can be based on the identification of integratedcircuit dies that are available for performing write operations at thetime of input/output scheduling. The media layout is determined suchthat logical addresses of the commands to be executed in parallel aremapped to different integrated circuit dies that are available forconcurrent/parallel operations without collision. Thus, media accesscollisions among the write commands from different active streams can becompletely avoided. When the number of active write streams is less thanthe number of integrated circuit dies in the memory sub-system, no mediaaccess collisions can occur when dynamic media layout is used. Ingeneral, a write stream includes a set of commands to write, trim,overwrite a set of data together as a group. In the group, the data canbe written in a logical space sequentially, randomly, orpseudo-sequentially. Preferably, the data in the group is written intoan erase block set, where memory cells in the erase block set store datafor the stream but not data from other streams. The erase block set canbe erased to remove the data of the stream without erasing the data ofother streams. In some instances, collisions can occur when the logicaladdresses of different streams are mapped into a same erase block setwhere the data of different streams cannot be separately erased. Suchcollision can also be avoided through the dynamic media layouttechnique.

FIG. 1 illustrates an example computing system 100 that includes amemory sub-system 110 in accordance with some embodiments of the presentdisclosure. The memory sub-system 110 can include media, such as one ormore volatile memory devices (e.g., memory device 102), one or morenon-volatile memory devices (e.g., memory device 104), or a combinationof such.

A memory sub-system 110 can be a storage device, a memory module, or ahybrid of a storage device and memory module. Examples of a storagedevice include a solid-state drive (SSD), a flash drive, a universalserial bus (USB) flash drive, an embedded Multi-Media Controller (eMMC)drive, a Universal Flash Storage (UFS) drive, a secure digital (SD)card, and a hard disk drive (HDD). Examples of memory modules include adual in-line memory module (DIMM), a small outline DIMM (SO-DIMM), andvarious types of non-volatile dual in-line memory module (NVDIMM).

The computing system 100 can be a computing device such as a desktopcomputer, laptop computer, network server, mobile device, a vehicle(e.g., airplane, drone, train, automobile, or other conveyance),Internet of Things (IoT) enabled device, embedded computer (e.g., oneincluded in a vehicle, industrial equipment, or a networked commercialdevice), or such computing device that includes memory and a processingdevice.

The computing system 100 can include a host system 120 that is coupledto one or more memory sub-systems 110. FIG. 1 illustrates one example ofa host system 120 coupled to one memory sub-system 110. As used herein,“coupled to” or “coupled with” generally refers to a connection betweencomponents, which can be an indirect communicative connection or directcommunicative connection (e.g., without intervening components), whetherwired or wireless, including connections such as electrical, optical,magnetic, etc.

The host system 120 can include a processor chipset (e.g., processingdevice 118) and a software stack executed by the processor chipset. Theprocessor chipset can include one or more cores, one or more caches, amemory controller (e.g., controller 116) (e.g., NVDIMM controller), anda storage protocol controller (e.g., PCIe controller, SATA controller).The host system 120 uses the memory sub-system 110, for example, towrite data to the memory sub-system 110 and read data from the memorysub-system 110.

The host system 120 can be coupled to the memory sub-system 110 via aphysical host interface. Examples of a physical host interface include,but are not limited to, a Serial Advanced Technology Attachment (SATA)interface, a Peripheral Component Interconnect Express (PCIe) interface,Universal Serial Bus (USB) interface, Fibre Channel, Serial AttachedSCSI (SAS), a Double Data Rate (DDR) memory bus, Small Computer SystemInterface (SCSI), a Dual In-line Memory Module (DIMM) interface (e.g.,DIMM socket interface that supports Double Data Rate (DDR)), Open NANDFlash Interface (ONFI), Double Data Rate (DDR), Low Power Double DataRate (LPDDR), or any other interface. The physical host interface can beused to transmit data between the host system 120 and the memorysub-system 110. The host system 120 can further utilize an NVM Express(NVMe) interface to access components (e.g., memory devices 104) whenthe memory sub-system 110 is coupled with the host system 120 by thePCIe interface. The physical host interface can provide an interface forpassing control, address, data, and other signals between the memorysub-system 110 and the host system 120. FIG. 1 illustrates a memorysub-system 110 as an example. In general, the host system 120 can accessmultiple memory sub-systems via a same communication connection,multiple separate communication connections, and/or a combination ofcommunication connections.

The processing device 118 of the host system 120 can be, for example, amicroprocessor, a central processing unit (CPU), a processing core of aprocessor, an execution unit, etc. In some instances, the controller 116can be referred to as a memory controller, a memory management unit,and/or an initiator. In one example, the controller 116 controls thecommunications over a bus coupled between the host system 120 and thememory sub-system 110. In general, the controller 116 can send commandsor requests to the memory sub-system 110 for desired access to memorydevices 102, 104. The controller 116 can further include interfacecircuitry to communicate with the memory sub-system 110. The interfacecircuitry can convert responses received from memory sub-system 110 intoinformation for the host system 120.

The controller 116 of the host system 120 can communicate withcontroller 115 of the memory sub-system 110 to perform operations suchas reading data, writing data, or erasing data at the memory devices102, 104 and other such operations. In some instances, the controller116 is integrated within the same package of the processing device 118.In other instances, the controller 116 is separate from the package ofthe processing device 118. The controller 116 and/or the processingdevice 118 can include hardware such as one or more integrated circuits(ICs) and/or discrete components, a buffer memory, a cache memory, or acombination thereof. The controller 116 and/or the processing device 118can be a microcontroller, special purpose logic circuitry (e.g., a FieldProgrammable Gate Array (FPGA), an Application Specific IntegratedCircuit (ASIC), etc.), or another suitable processor.

The memory devices 102, 104 can include any combination of the differenttypes of non-volatile memory components and/or volatile memorycomponents. The volatile memory devices (e.g., memory device 102) canbe, but are not limited to, Random Access Memory (RAM), such as DynamicRandom Access Memory (DRAM) and Synchronous Dynamic Random Access Memory(SDRAM).

Some examples of non-volatile memory components include a Negative-AND(NAND) type flash memory and write-in-place memory, such asthree-dimensional cross-point (“3D cross-point”) memory. A cross-pointarray of non-volatile memory can perform bit storage based on a changeof bulk resistance, in conjunction with a stackable cross-gridded dataaccess array. Additionally, in contrast to many flash-based memories,cross-point non-volatile memory can perform a write in-place operation,where a non-volatile memory cell can be programmed without thenon-volatile memory cell being previously erased. NAND type flash memoryincludes, for example, two-dimensional NAND (2D NAND) andthree-dimensional NAND (3D NAND).

Each of the memory devices 104 can include one or more arrays of memorycells. One type of memory cell, for example, Single Level Cells (SLCs)can store one bit per cell. Other types of memory cells, such asMulti-Level Cells (MLCs), Triple Level Cells (TLCs), Quad-Level Cells(QLCs), and penta-level cells (PLCs) can store multiple bits per cell.In some embodiments, each of the memory devices 104 can include one ormore arrays of memory cells such as SLCs, MLCs, TLCs, QLCs, or anycombination of such. In some embodiments, a particular memory device caninclude an SLC portion, and an MLC portion, a TLC portion, or a QLCportion of memory cells. The memory cells of the memory devices 104 canbe grouped as pages that can refer to a logical unit of the memorydevice used to store data. With some types of memory (e.g., NAND), pagescan be grouped to form blocks.

Although non-volatile memory devices such as 3D cross-point type andNAND type memory (e.g., 2D NAND, 3D NAND) are described, the memorydevice 104 can be based on any other type of non-volatile memory, suchas Read-Only Memory (ROM), Phase Change Memory (PCM), self-selectingmemory, other chalcogenide based memories, Ferroelectric TransistorRandom-Access Memory (FeTRAM), Ferroelectric Random Access Memory(FeRAM), Magneto Random Access Memory (MRAM), Spin Transfer Torque(STT)-MRAM, Conductive Bridging RAM (CBRAM), Resistive Random AccessMemory (RRAM), Oxide based RRAM (OxRAM), Negative-OR (NOR) flash memory,and Electrically Erasable Programmable Read-Only Memory (EEPROM).

A memory sub-system controller 115 (or controller 115 for simplicity)can communicate with the memory devices 104 to perform operations suchas reading data, writing data, or erasing data at the memory devices 104and other such operations (e.g., in response to commands scheduled on acommand bus by controller 116). The controller 115 can include hardwaresuch as one or more Integrated Circuits (ICs) and/or discretecomponents, a buffer memory, or a combination thereof. The hardware caninclude digital circuitry with dedicated (i.e., hard-coded) logic toperform the operations described herein. The controller 115 can be amicrocontroller, special purpose logic circuitry (e.g., a FieldProgrammable Gate Array (FPGA), an Application Specific IntegratedCircuit (ASIC), etc.), or another suitable processor.

The controller 115 can include a processing device 117 (processor)configured to execute instructions stored in a local memory 119. In theillustrated example, the local memory 119 of the controller 115 includesan embedded memory configured to store instructions for performingvarious processes, operations, logic flows, and routines that controloperation of the memory sub-system 110, including handlingcommunications between the memory sub-system 110 and the host system120.

In some embodiments, the local memory 119 can include memory registersstoring memory pointers, fetched data, etc. The local memory 119 canalso include Read-Only Memory (ROM) for storing micro-code. While theexample memory sub-system 110 in FIG. 1 has been illustrated asincluding the controller 115, in another embodiment of the presentdisclosure, a memory sub-system 110 does not include a controller 115,and can instead rely upon external control (e.g., provided by anexternal host, or by a processor or controller separate from the memorysub-system).

In general, the controller 115 can receive commands or operations fromthe host system 120 and can convert the commands or operations intoinstructions or appropriate commands to achieve the desired access tothe memory devices 104. The controller 115 can be responsible for otheroperations such as wear leveling operations, garbage collectionoperations, error detection and Error-Correcting Code (ECC) operations,encryption operations, caching operations, and address translationsbetween a logical address (e.g., Logical Block Address (LBA), namespace)and a physical address (e.g., physical block address) that areassociated with the memory devices 104. The controller 115 can furtherinclude host interface circuitry to communicate with the host system 120via the physical host interface. The host interface circuitry canconvert the commands received from the host system into commandinstructions to access the memory devices 104 as well as convertresponses associated with the memory devices 104 into information forthe host system 120.

The memory sub-system 110 can also include additional circuitry orcomponents that are not illustrated. In some embodiments, the memorysub-system 110 can include a cache or buffer (e.g., DRAM) and addresscircuitry (e.g., a row decoder and a column decoder) that can receive anaddress from the controller 115 and decode the address to access thememory devices 104.

In some embodiments, the memory devices 104 include local mediacontrollers 105 that operate in conjunction with memory sub-systemcontroller 115 to execute operations on one or more memory cells of thememory devices 104. An external controller (e.g., memory sub-systemcontroller 115) can externally manage the memory device 104 (e.g.,perform media management operations on the memory device 104). In someembodiments, a memory device 104 is a managed memory device, which is araw memory device combined with a local controller (e.g., localcontroller 105) for media management within the same memory devicepackage. An example of a managed memory device is a Managed NAND (MNAND)device.

The computing system 100 includes a dynamic data placer 113 in thememory sub-system 110 that dynamically determines the media layout toplace data associated with logical addresses in the media units/memorydevices 102 to 104. In some embodiments, the controller 115 in thememory sub-system 110 includes at least a portion of the dynamic dataplacer 113. In other embodiments, or in combination, the controller 116and/or the processing device 118 in the host system 120 includes atleast a portion of the dynamic data placer 113. For example, thecontroller 115, the controller 116, and/or the processing device 118 caninclude logic circuitry implementing the dynamic data placer 113. Forexample, the controller 115, or the processing device 118 (processor) ofthe host system 120, can be configured to execute instructions stored inmemory for performing the operations of the dynamic data placer 113described herein. In some embodiments, the dynamic data placer 113 isimplemented in an integrated circuit chip disposed in the memorysub-system 110. In other embodiments, the dynamic data placer 113 ispart of an operating system of the host system 120, a device driver, oran application.

The dynamic data placer 113 can determine the media layout for a portionof logical addresses for the placement of data at the logical addressesin the media units/memory devices 102 to 104, based on the availabilityof the media units/memory devices 102 to 104 to write, program, store,commit data at the time of input/output scheduling in the memorysub-system 110. When a media unit/memory devices (e.g., 102 or 104) isavailable for committing/programming data, a write command is scheduledfor execution in the memory sub-system 110; and the dynamic data placer113 generates a portion of the media layout for the write command andmaps the logical address(s) used in the write command to identify memorylocations with the media unit/memory devices (e.g., 102 or 104). Theexecution of the write command causes the memory sub-system 110 tocommitting/programming data associated with the write command into themedia unit/memory device (e.g., 102 or 104). Since the media unit/memorydevice (e.g., 102 or 104) are known to be available forcommitting/programming data, independent of the operations of othermedia unit/memory device (e.g., 102 or 104), there is no media accesscollision in the execution of the write commands. When there aremultiple media units/memory devices (e.g., 102 and 104) available,logical addresses used in the commands from multiple write streams canbe mapped by the dynamically generated portion of the media layout tothe multiple media units/memory devices (e.g., 102 and 104)respectively, such that there is no media access collision in theexecution of the commands from the multiple write streams. Furtherdetails with regards to the operations of the dynamic data placer 113are described below.

FIG. 2 shows a dynamic data placer 113 configured to determine a medialayout 130 in a way that reduces and/or avoids collisions in concurrentmedia accesses in writing data. For example, the dynamic data placer 113and the media layout 130 can be implemented in the computer system 100of FIG. 1.

In FIG. 2, multiple write commands 123A to 123N are scheduled forexecution in parallel. The number of write commands 123A to 123Nscheduled for parallel execution is based on the number of mediaunits/memory devices 109A to 109N (e.g., memory devices 102 and/or 104illustrated in FIG. 1) that are available for parallel operations. Thewrite commands 123A to 123N can be from multiple write streamsrespectively.

The write commands 123A to 123N specify locations for the writeoperations using logical block addressing (LBA) addresses 131, . . . ,133.

At the time of scheduling the write commands 123A to 123N, the dynamicdata placer 113 generates the mapping of the logical block addressing(LBA) addresses 131, . . . , 133 to physical addresses 141, . . . , 143.Since the media units/memory devices 109A to 109N are determined to beavailable for parallel write operations, the dynamic data placer 113maps each of the LBA addresses 131, . . . , 133 into a different one ofthe media units/memory devices 109A, . . . , 109N. Thus, the physicaladdresses 141, . . . , 143 for the LBA addresses 131, . . . , 133correspond to memory regions 151, . . . , 153 in different mediaunits/memory devices 109A, . . . , 109N. Since no two of the physicaladdresses 141, . . . , 143 are for memory regions in a same media unit(e.g., 109A or 109N), there can be no collision in the parallelexecution of the write commands 123A, . . . , 123N. Thus, media accesscollisions are eliminated.

In general, the write operations across the different media units/memorydevices 109A to 109N may not be in unison. Thus, when a subset of themedia units/memory devices 109A, . . . , 109N becomes available for nextwrite operations, another subset of the media units/memory devices 109A,. . . , 109N can be still busy in their operations and not available fornext write operations. Some of the media units/memory devices 109A, . .. , 109N can be busy in performing other operations, such as readoperations, erasure operations, and thus not available for performingwrite operations. In general, when one or more write commands arescheduled for the available subset of the media units/memory devices109A, . . . , 109N, the dynamic data placer 113 generates the portion ofthe media layout 103 to map the LBA address of the scheduled writecommands to the physical addresses of memory regions in the availablesubset of the media units/memory devices 109A, . . . , 109N. Thus, thescheduled commands can be executed with media access collisions.

FIG. 3 shows an example of a memory sub-system having dynamic dataplacement. For example, the memory sub-system of FIG. 3 can beimplemented in the memory sub-system 110 of FIG. 1 using a dynamic dataplacer 113 of FIG. 2. However, the techniques of FIG. 1 and FIG. 2 arenot limited to the implementation of the memory sub-system illustratedin FIG. 3. For example, the techniques can be implemented a plain blockdevice, a device that supports namespaces, or a device that supportszoned names spaces (e.g., a memory sub-system illustrated in FIG. 3).Thus, the disclosure presented herein is not limited to the example ofFIG. 3.

In FIG. 3, a namespace 201 is configured on the media storage capacityof the memory sub-system 110. The namespace 201 provides a logical blockaddressing space that can be used by the host system 120 to specifymemory locations for read or write operations. The namespace 201 can beallocated on a portion of the media storage capacity of the memorysub-system 110, or the entire media storage capacity of the memorysub-system 110. In some instances, multiple namespaces can be allocatedon separate, non-overlapping portions of the media storage capacity ofthe memory sub-system 110.

In FIG. 3, the namespace 201 is configured with a plurality of zones211, 213, . . . , 219. Each zone (e.g., 211) in the namespace allowsrandom read access to LBA addresses in the zone (e.g., 211) andsequential write access to LBA addresses in the zone (e.g., 211), butdoes not allow random write access to random LBA addresses in the zone(211). Thus, writing data into a zone (e.g., 211) is performed in apredetermined, sequential order in the LBA address space of thenamespace 201.

When a zone (e.g., 211) in the namespace 201 is configured, it ispossible to predetermine the media layout for the zone (e.g., 211)(e.g., for simplicity). The LBA addresses in the zone (e.g., 211) can bepre-mapped to the media 203 of the memory sub-system 110. However, sucha predetermined media layout can cause media access collisions whenthere are multiple parallel write streams, as discussed above. Randomizethe mapping from LBA addresses in the zone (e.g., 211) to memorylocations in the media 203 can reduce collisions but cannot eliminatecollisions.

Preferably, the dynamic data placer 113 is configured in the memorysub-system 110 to create portions of the media layout 130 at the time ofthe scheduling of write commands for execution such that collisions arecomplete eliminated.

For example, the media 203 of the memory sub-system 110 can havemultiple integrated circuit dies 205, . . . , 207. Each of theintegrated circuit dies (e.g., 205) can have multiple planes 221, . . ., 223 of memory units (e.g., NAND memory cells). Each of the planes(e.g., 221) can have multiple blocks 231, . . . , 233 of memory units(e.g., NAND memory cells). Each of the blocks (e.g., 231) can havemultiple pages 241, . . . , 243 of memory units (e.g., NAND memorycells). The memory units in each page (e.g., 241) is configured to beprogrammed to store/write/commit data together in an atomic operation;and the memory units in each block (e.g., 231) is configured to beerased data together in an atomic operation.

When a write command (e.g., 123A) for storing data in one zone (e.g.,211) and another write command (e.g., 123N) for storing data in anotherzone (e.g., 213) are scheduled for parallel execution as a result of twointegrated circuit dies (e.g., 205 and 207) are available for concurrentoperations, the dynamic data placer 113 maps the LBA addresses (e.g.,131 and 133) of the write commands (e.g., 123A and 123N) into pageslocated in the different dies (e.g., 205 and 207). Thus, media accesscollisions can be avoided.

FIG. 4 illustrates an example of data structures configured to supportdynamic data placement. For example, the media layout 130 of FIG. 2 or 3can be implemented using the data structures of FIG. 4.

In FIG. 4, a zone map 301 is configured to provide media layoutinformation for a zone (e.g., 211) in a namespace (e.g., 201). The zonemap 301 can have multiple entries. Each entry in the zone map 301identifies information about a zone (e.g., 211), such as a starting LBAaddress 311 of the zone (e.g., 211), a block set identifier 313 of thezone (e.g., 211), a cursor value 315 of the zone (e.g., 211), a state317 of the zone (e.g., 211), etc.

The host system 120 writes data in the zone (e.g., 211) starting at thezone starting LBA address 311. The host system 120 writes data in thezone (e.g., 211) sequentially in the LBA space. After an amount of datahas been written into the zone (e.g., 211), the current starting LBAaddress for writing subsequent data is identified by the cursor value315. Each write command for the zone moves the cursor value 315 to a newstarting LBA address for the next write command for the zone. The state317 can have a value indicating that the zone (e.g., 211) is empty,full, implicitly open, explicitly open, closed, etc.

In FIG. 4, a logical to physical block map 303 is configured tofacilitate the translation of LBA addresses (e.g., 331) into physicaladdresses in the media (e.g., 203).

The logical to physical block map 303 can have multiple entries. An LBAaddress (e.g., 331) can be used as, or converted into, an index for anentry in the logical to physical block map 303. The index can be used tolook up an entry for the LBA address (e.g., 331). Each entry in thelogical to physical block map 303 identifies, for an LBA address (e.g.,331), the physical address of a block of memory in the media (e.g.,203). For example, the physical address of the block of memory in themedia (e.g., 203) can include a die identifier 333, a block identifier335, a page map entry identifier 337, etc.

A die identifier 333 identifies a specific integrated circuit die (e.g.,205 or 207) in the media 203 of the memory sub-system 110.

A block identifier 335 identifies a specific block of memory (e.g., NANDflash memory) within the integrated circuit die (e.g., 205 or 207) thatis identified using the die identifier 333.

A page map entry identifier 337 identifies an entry in a page map 305.

The page map 305 can have multiple entries. Each entry in the page map305 can include a page identifier 351 that identifies a page of memorycells within a block of memory cells (e.g., NAND memory cells). Forexample, the page identifier 351 can include a word line number for thepage and a sub block number for the page in the block of NAND memorycells. Further, the entry for the page can include a programming mode353 of the page. For example, the page can be programmed in an SLC mode,an MLC mode, a TLC mode, or a QLC mode. When configured in the SLC mode,each memory cell in the page is to store one bit of data. Whenconfigured in the MLC mode, each memory cell in the page is to store twobits of data. When configured in the TLC mode, each memory cell in thepage is to store three bits of data. When configured in the QLC mode,each memory cell in the page is to store four bits of data. Differentpages in an integrated circuit die (e.g., 205 or 207) can have differentmodes for data programming.

In FIG. 4, the block set table 307 stores data controlling aspects ofthe dynamic media layout for a zone (e.g., 211).

The block set table 307 can have multiple entries. Each entry in theblock set table 307 identifies a number/count 371 of integrated circuitdies (e.g., 205 and 207) in which data of the zone (e.g., 211) isstored. For each of the integrated circuit dies (e.g., 205 and 207) usedfor the zone (e.g., 211), the entry of the block set table 307 has a dieidentifier 373, a block identifier 375, a page map entry identifier 377,etc.

The die identifier 373 identifies a specific integrated circuit die(e.g., 205 or 207) in the media 203 of the memory sub-system 110, onwhich die (e.g., 205 or 207) subsequent data of the zone (e.g., 211) canbe stored.

The block identifier 375 identifies a specific block (e.g., 231 or 233)of memory (e.g., NAND flash memory) within the integrated circuit die(e.g., 205 or 207) that is identified using the die identifier 373, inwhich block (e.g., 231 or 233) the subsequent data of the zone (e.g.,211) can be stored.

The page map entry identifier 337 identifies an entry in the page map305, which identifies a page (e.g., 241 or 241) that can be used tostore the subsequent data of the zone (e.g., 211).

FIG. 5 shows a method of dynamic data placement. The method of FIG. 5can be performed by processing logic that can include hardware (e.g.,processing device, circuitry, dedicated logic, programmable logic,microcode, hardware of a device, integrated circuit, etc.), software(e.g., instructions run or executed on a processing device), or acombination thereof. In some embodiments, the method of FIG. 5 isperformed at least in part by the dynamic data placer 113 of FIG. 1, 2,or 3. Although shown in a particular sequence or order, unless otherwisespecified, the order of the processes can be modified. Thus, theillustrated embodiments should be understood only as examples, and theillustrated processes can be performed in a different order, and someprocesses can be performed in parallel. Additionally, one or moreprocesses can be omitted in various embodiments. Thus, not all processesare required in every embodiment. Other process flows are possible.

At block 401, a memory sub-system 110 receives multiple streams of writecommands. For example, each respective stream in the multiple streams isconfigured to write data sequentially in a logical address space in oneembodiment; and in another embodiment, a stream in the multiple streamsis configured to write data pseudo-sequentially, or randomly in alogical address space in one embodiment. Each write stream includes aset of commands that are tagged to write, trim, overwrite a set of datatogether as a group. In the group, the data can be written in a logicalspace sequentially, randomly, or pseudo-sequentially. Preferably, thedata in the group is written into an erase block set, where memory cellsin the erase block set store data for the stream but not data from otherstreams. The erase block set can be erased to remove the data of thestream without erasing the data of other streams.

For example, each of write streams is permitted to sequentially write atLBA addresses in a zone (e.g., 211) in a namespace (e.g., 201) allocatedon a media 203 of the memory sub-system 110, but prohibited from writingdata out of sequence in the LBA address space.

At block 403, a dynamic data placer 113 of the memory sub-system 110identifies multiple media units (e.g., 109A to 109N) in the memorysub-system that are available to write data concurrently.

At block 405, the dynamic data placer 113 selects first commands fromthe multiple streams for concurrent execution in the multiple mediaunits that are available to write data.

At block 407, the dynamic data placer 113 generates and stores,dynamically in response to the first commands being selected forconcurrent execution in the multiple media units, a portion of a medialayout 130 that maps from logical addresses identified by the firstcommands in the logical address space to physical addresses of memoryunits in the multiple media units.

At block 409, the memory sub-system 110 executes the first commandsconcurrently by storing data into the memory units according to thephysical addresses.

For example, at the time of scheduling the first commands for execution,execution second commands can be in progress in a subset of memory unitsof the media of the memory sub-system 110. Thus, the subset of memoryunits used for the execution of the second commands are not availablefor the first commands. After the first commands are scheduled and theportion of the media layout for the logical addresses used in the firstcommands is determined, the first commands can be executed in themultiple media units concurrently and/or concurrently with the progressof the execution of the second commands in remaining media units of thememory sub-system 110.

For example, after the identification of the multiple memory units(e.g., integrate circuit dies) that are available for the execution ofnext commands, the dynamic data placer 113 can identify, from the blockset table 307, the physical addresses that can be used to store data ofthe next commands. The physical addresses can be used to update thecorresponding entries in the logical to physical block map 303 for theLBA addresses used in the next commands.

For example, when an integrated circuit die (e.g., 205) is free to writedata, the dynamic data placer 113 can determine a command of a zone thatcan be written/programmed into the memory cells in the integratedcircuit die (e.g., 205). From the block set table 307, the dynamic dataplacer 113 locates an entry for the zone (e.g., 205), locate the blockidentifier 375 and the page map entry identifier 377 associated with theidentifier 373 of the integrated circuit die (e.g., 205), and use thedie identifier 373, the block identifier 375, and the page map entryidentifier 377 to update the corresponding fields of the entry in thelogical to physical block map 303 for the LBA address 331 used in thecommand of the zone (e.g., 211). Thus, the command of the zone (e.g.,211) can be executed without media access collision for the LBA address331.

FIG. 6 illustrates an example of dynamic media layout determination.

In the example of FIG. 6, two concurrent write streams 420 and 430 areillustrated. Stream 420 has items 421, 423, 425, . . . , 429 to bewritten into memory cells of integrated circuit dies 441, 443, 445, . .. . Stream 430 has items 431, 433, 435, . . . , 439 to be written intomemory cells of integrated circuit dies 441, 443, 445, . . . . If item421 of stream 420 and item 431 of stream 452 are assigned to be writteninto the same die (e.g., 441), a collision occurs, since the die (e.g.,441) cannot be used to concurrently write the item 421 of stream 420 andthe item 431 of stream 430. Thus, a dynamic data placer (e.g., 113 inFIG. 1, 2, or 3) assigns the items 421 and 431 of concurrent streams 420and 430 to pages 451 and 454 in different dies 441 and 443, asillustrated in FIG. 6. Similarly, items 423 and 433 from the concurrentstreams 420 and 430 are assigned to pages 453 and 42 in different dies443 and 441. For example, when the item 425 of stream 420 is assigned topage 455 in die 455, the concurrently item 435 is assigned to be writteninto a page in another die; and the page 457 in the die 445 can beassigned to item 439 of stream 430 that is not written/programmedconcurrently with the item 425 of stream 420. Thus, collisions areavoided. The dynamic media layout changes the order of items beingwritten relative to the order of the dies 441, 443, 445, . . . . Forexample, items 421 to 429 of stream 420 are written into the dies 441,443, 445, . . . in one order; and items 431 to 439 of stream 430 arewritten into the dies 441, 443, 445, . . . in another order, such thatthe streams 420 and 430 do not access the same die at the same time. InFIG. 6, the data of different streams 420 and 430 are tagged to bewritten into different erase blocks. For example, page 451 in die 441for storing the data item 421 of stream 420 and page 452 in die 441 forstoring the data item 431 of stream 430 are in separate erase blocksets, such that page 451 of stream 420 can be erased without erasingpage 452 storing the data of stream 430 and such that page 452 of stream430 can be erased without erasing page 451 storing the data of stream420.

In some implementations, a communication channel between the processingdevice 118 and a memory sub-system 110 includes a computer network, suchas a local area network, a wireless local area network, a wirelesspersonal area network, a cellular communications network, a broadbandhigh-speed always-connected wireless communication connection (e.g., acurrent or future generation of mobile network link); and the processingdevice 118 and the memory sub-system can be configured to communicatewith each other using data storage management and usage commands similarto those in NVMe protocol.

A memory sub-system 110 in general can have non-volatile storage media.Examples of non-volatile storage media include memory cells formed in anintegrated circuit and magnetic material coated on rigid disks.Non-volatile storage media can maintain the data/information storedtherein without consuming power. Memory cells can be implemented usingvarious memory/storage technologies, such as NAND logic gate, NOR logicgate, Phase-Change Memory (PCM), Magnetic Random Access Memory (MRAM),resistive random-access memory, cross point storage and memory devices(e.g., 3D XPoint memory). A cross point memory device usestransistor-less memory elements, each of which has a memory cell and aselector that are stacked together as a column. Memory element columnsare connected via two perpendicular lays of wires, where one lay isabove the memory element columns and the other lay below the memoryelement columns. Each memory element can be individually selected at across point of one wire on each of the two layers. Cross point memorydevices are fast and non-volatile and can be used as a unified memorypool for processing and storage.

The controller (e.g., 115) of a memory sub-system (e.g., 110) can runfirmware to perform operations responsive to the communications from theprocessing device 118. Firmware in general is a type of computer programthat provides control, monitoring and data manipulation of engineeredcomputing devices.

Some embodiments involving the operation of the controller 115 can beimplemented using computer instructions executed by the controller 115,such as the firmware of the controller 115. In some instances, hardwarecircuits can be used to implement at least some of the functions. Thefirmware can be initially stored in the non-volatile storage media, oranother non-volatile device, and loaded into the volatile DRAM and/orthe in-processor cache memory for execution by the controller 115.

A non-transitory computer storage medium can be used to storeinstructions of the firmware of a memory sub-system (e.g., 110). Whenthe instructions are executed by the controller 115 and/or theprocessing device 117, the instructions cause the controller 115 and/orthe processing device 117 to perform a method discussed above.

FIG. 7 illustrates an example machine of a computer system 500 withinwhich a set of instructions, for causing the machine to perform any oneor more of the methodologies discussed herein, can be executed. In someembodiments, the computer system 500 can correspond to a host system(e.g., the host system 120 of FIG. 1) that includes, is coupled to, orutilizes a memory sub-system (e.g., the memory sub-system 110 of FIG. 1)or can be used to perform the operations of a dynamic data placer 113(e.g., to execute instructions to perform operations corresponding tothe dynamic data placer 113 described with reference to FIGS. 1-5). Inalternative embodiments, the machine can be connected (e.g., networked)to other machines in a LAN, an intranet, an extranet, and/or theInternet. The machine can operate in the capacity of a server or aclient machine in client-server network environment, as a peer machinein a peer-to-peer (or distributed) network environment, or as a serveror a client machine in a cloud computing infrastructure or environment.

The machine can be a personal computer (PC), a tablet PC, a set-top box(STB), a Personal Digital Assistant (PDA), a cellular telephone, a webappliance, a server, a network router, a switch or bridge, or anymachine capable of executing a set of instructions (sequential orotherwise) that specify actions to be taken by that machine. Further,while a single machine is illustrated, the term “machine” shall also betaken to include any collection of machines that individually or jointlyexecute a set (or multiple sets) of instructions to perform any one ormore of the methodologies discussed herein.

The example computer system 500 includes a processing device 502, a mainmemory 504 (e.g., read-only memory (ROM), flash memory, dynamic randomaccess memory (DRAM) such as synchronous DRAM (SDRAM) or Rambus DRAM(RDRAM), static random access memory (SRAM), etc.), and a data storagesystem 518, which communicate with each other via a bus 530 (which caninclude multiple buses).

Processing device 502 represents one or more general-purpose processingdevices such as a microprocessor, a central processing unit, or thelike. More particularly, the processing device can be a complexinstruction set computing (CISC) microprocessor, reduced instruction setcomputing (RISC) microprocessor, very long instruction word (VLIW)microprocessor, or a processor implementing other instruction sets, orprocessors implementing a combination of instruction sets. Processingdevice 502 can also be one or more special-purpose processing devicessuch as an application specific integrated circuit (ASIC), a fieldprogrammable gate array (FPGA), a digital signal processor (DSP),network processor, or the like. The processing device 502 is configuredto execute instructions 526 for performing the operations and stepsdiscussed herein. The computer system 500 can further include a networkinterface device 508 to communicate over the network 520.

The data storage system 518 can include a machine-readable storagemedium 524 (also known as a computer-readable medium) on which is storedone or more sets of instructions 526 or software embodying any one ormore of the methodologies or functions described herein. Theinstructions 526 can also reside, completely or at least partially,within the main memory 504 and/or within the processing device 502during execution thereof by the computer system 500, the main memory 504and the processing device 502 also constituting machine-readable storagemedia. The machine-readable storage medium 524, data storage system 518,and/or main memory 504 can correspond to the memory sub-system 110 ofFIG. 1.

In one embodiment, the instructions 526 include instructions toimplement functionality corresponding to a dynamic data placer 113(e.g., the dynamic data placer 113 described with reference to FIGS.1-5). While the machine-readable storage medium 524 is shown in anexample embodiment to be a single medium, the term “machine-readablestorage medium” should be taken to include a single medium or multiplemedia that store the one or more sets of instructions. The term“machine-readable storage medium” shall also be taken to include anymedium that is capable of storing or encoding a set of instructions forexecution by the machine and that cause the machine to perform any oneor more of the methodologies of the present disclosure. The term“machine-readable storage medium” shall accordingly be taken to include,but not be limited to, solid-state memories, optical media, and magneticmedia.

Some portions of the preceding detailed descriptions have been presentedin terms of algorithms and symbolic representations of operations ondata bits within a computer memory. These algorithmic descriptions andrepresentations are the ways used by those skilled in the dataprocessing arts to most effectively convey the substance of their workto others skilled in the art. An algorithm is here, and generally,conceived to be a self-consistent sequence of operations leading to adesired result. The operations are those requiring physicalmanipulations of physical quantities. Usually, though not necessarily,these quantities take the form of electrical or magnetic signals capableof being stored, combined, compared, and otherwise manipulated. It hasproven convenient at times, principally for reasons of common usage, torefer to these signals as bits, values, elements, symbols, characters,terms, numbers, or the like.

It should be borne in mind, however, that all of these and similar termsare to be associated with the appropriate physical quantities and aremerely convenient labels applied to these quantities. The presentdisclosure can refer to the action and processes of a computer system,or similar electronic computing device, that manipulates and transformsdata represented as physical (electronic) quantities within the computersystem's registers and memories into other data similarly represented asphysical quantities within the computer system memories or registers orother such information storage systems.

The present disclosure also relates to an apparatus for performing theoperations herein. This apparatus can be specially constructed for theintended purposes, or it can include a general purpose computerselectively activated or reconfigured by a computer program stored inthe computer. Such a computer program can be stored in a computerreadable storage medium, such as, but not limited to, any type of diskincluding floppy disks, optical disks, CD-ROMs, and magnetic-opticaldisks, read-only memories (ROMs), random access memories (RAMs), EPROMs,EEPROMs, magnetic or optical cards, or any type of media suitable forstoring electronic instructions, each coupled to a computer system bus.

The algorithms and displays presented herein are not inherently relatedto any particular computer or other apparatus. Various general purposesystems can be used with programs in accordance with the teachingsherein, or it can prove convenient to construct a more specializedapparatus to perform the method. The structure for a variety of thesesystems will appear as set forth in the description below. In addition,the present disclosure is not described with reference to any particularprogramming language. It will be appreciated that a variety ofprogramming languages can be used to implement the teachings of thedisclosure as described herein.

The present disclosure can be provided as a computer program product, orsoftware, that can include a machine-readable medium having storedthereon instructions, which can be used to program a computer system (orother electronic devices) to perform a process according to the presentdisclosure. A machine-readable medium includes any mechanism for storinginformation in a form readable by a machine (e.g., a computer). In someembodiments, a machine-readable (e.g., computer-readable) mediumincludes a machine (e.g., a computer) readable storage medium such as aread only memory (“ROM”), random access memory (“RAM”), magnetic diskstorage media, optical storage media, flash memory devices, etc.

In this description, various functions and operations are described asbeing performed by or caused by computer instructions to simplifydescription. However, those skilled in the art will recognize what ismeant by such expressions is that the functions result from execution ofthe computer instructions by one or more controllers or processors, suchas a microprocessor. Alternatively, or in combination, the functions andoperations can be implemented using special purpose circuitry, with orwithout software instructions, such as using Application-SpecificIntegrated Circuit (ASIC) or Field-Programmable Gate Array (FPGA).Embodiments can be implemented using hardwired circuitry withoutsoftware instructions, or in combination with software instructions.Thus, the techniques are limited neither to any specific combination ofhardware circuitry and software, nor to any particular source for theinstructions executed by the data processing system.

In the foregoing specification, embodiments of the disclosure have beendescribed with reference to specific example embodiments thereof. Itwill be evident that various modifications can be made thereto withoutdeparting from the broader spirit and scope of embodiments of thedisclosure as set forth in the following claims. The specification anddrawings are, accordingly, to be regarded in an illustrative senserather than a restrictive sense.

What is claimed is:
 1. A method, comprising: receiving, in a memorysub-system, a plurality of streams of write commands; identifying aplurality of media units in the memory sub-system, wherein the pluralityof media units are available to write data from the plurality of streamsconcurrently; selecting first commands from the plurality of streams forconcurrent execution in the plurality of media units; generating andstoring, dynamically in response to the first commands from a pluralityof write streams being selected for concurrent execution in theplurality of media units, a portion of a media layout that maps: fromlogical addresses, identified by the first commands from the pluralityof write streams, in the logical address space, to physical addresses ofmemory units in the plurality of media units; and executing the firstcommands concurrently by storing data into the memory units according tothe physical addresses.
 2. The method of claim 1, wherein the pluralityof streams of write commands are configured to write data in a pluralityof erase block sets respectively in the memory sub-system.
 3. The methodof claim 2, wherein each of the plurality of streams of write commandsis tagged to store data as a group in a respective one of the eraseblock sets.
 4. The method of claim 3, wherein the logical address spaceis defined in a namespace of the memory sub-system; the namespace isconfigured with a plurality of zones; each respective stream in theplurality of streams is configured to write data sequentially in alogical address space; and the each respective stream is configured towrite in one of the plurality of zones.
 5. The method of claim 4,wherein each respective zone in the namespace prohibits non-sequentialwrite operations in the logical address space; and the each respectivezone in the namespace allows random read operations in the logicaladdress space.
 6. The method of claim 3, wherein each of the pluralityof media units is identified based on being on a separate integratedcircuit die of memory units.
 7. The method of claim 6, wherein theportion of the media layout includes mapping between logical blockaddressing (LBA) addresses in the namespace and blocks of NAND memory inseparate integrated circuit dies.
 8. A non-transitory computer storagemedium storing instructions which, when executed in a memory sub-system,causes the memory sub-system to perform a method, the method comprising:receiving, in the memory sub-system, a plurality of streams of writecommands; identifying a plurality of media units in the memorysub-system, wherein the plurality of media units are available to writedata concurrently; selecting first commands from a plurality of writestreams for concurrent execution in the plurality of media units;generating and storing, dynamically in response to the first commandsbeing selected for concurrent execution in the plurality of media units,a portion of a media layout that maps: from logical addresses,identified by the first commands from the plurality of write streams, inthe logical address space, to physical addresses of memory units in theplurality of media units; and executing the first commands concurrentlyby storing data into the memory units according to the physicaladdresses.
 9. The non-transitory computer storage medium of claim 8,wherein the plurality of streams of write commands are configured towrite data in a plurality of erase block sets respectively in the memorysub-system.
 10. The non-transitory computer storage medium of claim 9,wherein each of the plurality of streams of write commands is tagged tostore data as a group in a respective one of the erase block sets. 11.The non-transitory computer storage medium of claim 10, wherein thelogical address space is defined in a namespace of the memorysub-system; the namespace is configured with a plurality of zones; andthe each respective stream is configured to write in one of theplurality of zones.
 12. The non-transitory computer storage medium ofclaim 11, wherein each respective zone in the namespace prohibitsnon-sequential write operations in the logical address space; and theeach respective zone in the namespace allows random read operations inthe logical address space.
 13. The non-transitory computer storagemedium of claim 10, wherein each of the plurality of media units isidentified based on being on a separate integrated circuit die of memoryunits.
 14. The non-transitory computer storage medium of claim 13,wherein the portion of the media layout includes mapping between logicalblock addressing (LBA) addresses in the namespace and blocks of NANDmemory in separate integrated circuit dies.
 15. A memory sub-system,comprising: a plurality of media units capable of writing dataconcurrently; and at least one processing device configured to: receivea plurality of streams of write commands; identify one or more firstmedia units among the plurality of media units, wherein the one or morefirst media units are currently available to write data concurrentlywith one or more second media units among the plurality of media units,wherein the one or more second media units are in progress of writingdata; select one or more first commands from the plurality of streamsfor concurrent execution with one or more second commands that are inprogress in the one or more second media units; generate and store,dynamically in response to the one or more first commands being selectedfor the concurrent execution, a portion of a media layout that maps fromlogical addresses identified by the one or more first commands in thelogical address space to physical addresses of memory units in the oneor more first media units; and execute the one or more first commandsconcurrently by storing data into the memory units according to thephysical addresses, concurrently with the one or more second commands inprogress in the one or more second media units.
 16. The memorysub-system of claim 15, wherein the plurality of streams of writecommands are configured to write data in a plurality of erase block setsrespectively in the memory sub-system; and each of the plurality ofstreams of write commands is tagged to store data as a group in arespective one of the erase block sets.
 17. The memory sub-system ofclaim 16, wherein the logical address space is defined in a namespace ofthe memory sub-system; the namespace is configured with a plurality ofzones; and the each respective stream is configured to write in one ofthe plurality of zones.
 18. The memory sub-system of claim 17, whereineach respective zone in the namespace prohibits non-sequential writeoperations in the logical address space; and the each respective zone inthe namespace allows random read operations in the logical addressspace.
 19. The memory sub-system of claim 16, wherein each of theplurality of media units is identified based on being on a separateintegrated circuit die of memory units.
 20. The memory sub-system ofclaim 19, wherein the portion of the media layout includes mappingbetween logical block addressing (LBA) addresses in the namespace andblocks of NAND memory in separate integrated circuit dies.